Maximum entropy models from phase harmonic covariances
نویسندگان
چکیده
The covariance of a stationary process X is diagonalized by Fourier transform. It does not take into account the complex phase and defines Gaussian maximum entropy models. We introduce general family harmonic moments, which rely on phases to capture non-Gaussian properties. They are defined as Hˆ(LX), where L linear operator Hˆ non-linear multiplies each coefficient integers. can also be calculated from rectifiers, relates Hˆ(LX) neural network coefficients. If transform then sparse matrix whose non-zero off-diagonal coefficients dependencies between frequencies. These have similarities with high order but smaller statistical variabilities because Lipschitz. wavelet reveal across scales, specify geometry local coherent structures. models conditioned these covariances. precision numerically evaluated synthesize images turbulent flows other processes.
منابع مشابه
Chunking with Maximum Entropy Models
Maximum Entropy (MaxEnt) models (Jaynes, 1957) are exponential models that implement the intuition that if there is no evidence to favour one alternative solution above another, both alternatives should be equally likely. In order to accomplish this, as much information as possible about the process you want to model must be collected. This information consists of frequencies of events relevant...
متن کاملCompact Maximum Entropy Language Models
In language modeling we are always confronted with a sparse data problem. The Maximum Entropy formalism allows to fully integrate complementary statistical properties of limited corpora. The focus of the present paper is twofold. The new smoothing technique of LM-induced marginals is introduced and discussed. We then highlight the advantages resulting from a combination of robust features and s...
متن کاملFrom Maximum Entropy to Maximum Entropy Production: A New Approach
Evidence from climate science suggests that a principle of maximum thermodynamic entropy production can be used to make predictions about some physical systems. I discuss the general form of this principle and an inherent problem with it, currently unsolved by theoretical approaches: how to determine which system it should be applied to. I suggest a new way to derive the principle from statisti...
متن کاملMixtures of Conditional Maximum Entropy Models
Driven by successes in several application areas, maximum entropy modeling has recently gained considerable popularity. We generalize the standard maximum entropy formulation of classification problems to better handle the case where complex data distributions arise from a mixture of simpler underlying (latent) distributions. We develop a theoretical framework for characterizing data as a mixtu...
متن کاملHow biased are maximum entropy models?
Maximum entropy models have become popular statistical models in neuroscience and other areas in biology, and can be useful tools for obtaining estimates of mutual information in biological systems. However, maximum entropy models fit to small data sets can be subject to sampling bias; i.e. the true entropy of the data can be severely underestimated. Here we study the sampling properties of est...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied and Computational Harmonic Analysis
سال: 2021
ISSN: ['1096-603X', '1063-5203']
DOI: https://doi.org/10.1016/j.acha.2021.01.003